Can under-exploited structure of original-classes help ECOC-based multi-class classification?

Can under-exploited structure of original-classes help ECOC-based multi-class classification? Yunyun Wang Songcan Chen Hui Xue School of Computer Science and Engineering, Nanjing University of Aeronautics & Astronautics, 210016, Nanjing, P.R. China School of Computer Science and Engineering, Southeast University, 210096, Nanjing, P.R. China Abstract: Error Correcting Output Codes (ECOC) is a popular framework for addressing multi-class classification problems by combing multiple binary sub-problems. In each binary sub-problem, at least one class is actually a “meta-class” consisting of multiple original classes, and treated as a single class in the learning process. This strategy brings a simple and common implementation of multi-class classification, but simultaneously results in the under-exploitation of already-provided structure knowledge in individual original classes. In this paper, we present a new methodology to show that the utilization of such prior structure knowledge can further strengthen the performance of ECOCs, and the structure knowledge is formulated respectively under the cluster and manifold assumptions. Finally we validate our methodology on both toy and real benchmark datasets (UCI, face recognition and objective category), consequently validate the structure knowledge of individual original classes for ECOC-based multi-class classification.